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Site-specific variable nitrogen application is one of the major operations in precision crop production 
management. Estimating crop nitrogen stress accurately during side-dressing operations is essential for 
managing site-specific nitrogen applications effectively. Various off-line assessing methods of nitrogen stress, 
such as aerial images of the field, crop tissue analysis, soil sampling analysis and soil plant analysis 
development (SPAD) meter readings of crop leaf, have been applied in current site-specific crop production 
management. To support a machinery-mounted multi-spectral imaging sensor to detect nitrogen stress during 
side-dressing operations, a neural-network model was created to estimate maize leaf SPAD values based on 
the sensed reflectance of maize canopy in three channels of green (G), red (R) and near-infrared (NIR) of a 
multi-spectral charge-coupled device (CCD) camera. Based on results obtained from both off-line post¬ 
processing and real-time field tests, it was verified that the developed neural-network model was capable of 
extracting stress information with reasonable accuracy in real-time in terms of sensed crop canopy reflectance 

• • • O • 

in G, R and NIR channels. The coefficient of determination r between estimated and measured SPAD values 

was 0-89 and a root mean square (RMS) error of 2-52 was observed from validation tests. 
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1. Introduction 

Site-specific crop-production management (SCM) is 
an information-based technology for production agri¬ 
culture management (Robert et al ., 1995). Nitrogen is an 
essential nutrient for crops to grow, but excessive 
fertilisation results in adverse effects on the environment 
(Schepers et al., 1991). Owing to the spatial variability in 
soil properties, the crop growth conditions are often 
uneven within a field. While uneven growth provides the 
opportunity to increase the yield by applying sufficient 
nitrogen fertilizer to nitrogen-stressed crops to achieve 
even yield across the field, it may also cause excessive 
nitrogen application by adding more nitrogen than 
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needed at places where crops are already healthily 
growing. Site-specific crop-production management 
aims to optimise profitability and sustainability of the 
production by means of planning field operations in 
terms of crop growth conditions in small manageable 
zones. Among all SCM activities, site-specific nitrogen 
management, which determines the optimal amount of 
nitrogen fertiliser for specific locations in the field based 
on crop growth condition and yield potential, is one of 
the most frequently practised operations. 

Conventional nitrogen management for maize pro¬ 
duction is characterised by uniform rate application 
across the field either in late autumn, early spring or in 
some cases as side-dressing. Comparing with conven¬ 
tional nitrogen application methods, variable-rate side¬ 
dressing during the growing season has less potential for 
nitrogen leaching because the drier soil and deeper roots 
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Notation 

x, x min , x max , real, minimum, maximum, normalised 

x norm value of an input variable 

y, ymin, ymax , real, minimum, maximum, indexed 

y nor m value of an output variable 


prevent the water from percolating to depths below the 
root zone (Auernhammer et al ., 1999; Van Es & 
Trautmann, 1990). Moreover, the effectiveness of 
variable-rate side-dressing heavily relies on the capabil¬ 
ity of detecting nitrogen stress during the application. 
Currently, crop producers use chlorophyll meters to 
measure leaf transmittance and assess the nitrogen stress 
level in order to acquire nitrogen stress information 
(Piekielek & Fox, 1992; Tumbo et al ., 2002). One major 
weakness of this method is that only a few data points 
are obtained due to the heavy workload of manual field 
data collection. This limited number of data points may 
inadequately represent the distribution of crop nitrogen 
stress across the field. 

To obtain more complete and accurate information 
on nitrogen stress distribution to and increase effective 
site-specific nitrogen management, researchers devel¬ 
oped various methods to estimate leaf chlorophyll 
content based on multi-spectral images of the crop 
canopy (Moran et al ., 1997; Thai et al, 1998; Yang 
et al ., 2000; Borhan et al ., 2004). Satellite-based multi- 
spectral image was found to be a feasible technology to 
estimate crop yield (McDonald & Hall, 1980; Thorp 
et al ., 2004). Kim et al. (2000, 2001) investigated the use 
of a multi-spectral camera as a machinery-mounted 
imaging sensor to collect high-resolution crop canopy 
reflectance data in the field. To increase the sensitivity of 
the multi-spectral (MSI) imaging sensor, Gitelson et al. 
(1997) proposed a normalised difference vegetation 
index (NDVI) to estimate vegetation canopy coverage 
in fields. Field validation test results verified that the 
NDVI approach was more sensitive than a direct 
reflectance measurement approach in detecting low 
chlorophyll content (Shapiro, 1999; Jones et al ., 2004). 

The determination of the correlation between the 
vegetation indices and nitrogen stress levels is a 
challenging task in assessing crop growth status. Wang 
and Thai (2003) created a generic algorithm model to 
select an optimal second-order polynomial model to 
assess crop nitrogen stress based on a ratio of leaf 
reflectance measured in the 700 and 740 nm bands. 
Tumbo et al. (2002) developed a backpropagation (BP) 
neural-network model to estimate chlorophyll readings 
based on spectrometry readings, and verified that 
estimated values from this neural-network model 
correlated the actual chlorophyll measurement reason¬ 


ably well. This research developed an effective data- 
mapping model to estimate crop leaf chlorophyll read¬ 
ings [namely, the soil plant analysis development 
(SPAD) meter readings] based on multi-spectral maize 
crop images to assess crop nitrogen stress ‘on-the-go’ 
during variable-rate side-dressing operations. The devel¬ 
opment of the real-time multi-spectral image-processing 
method for this machinery-mounted sensor will be 
reported in a separate paper (Noh et al ., 2005). This 
paper focuses on reporting the creation of a neural- 
network data-mapping model. 

2. Materials and methods 

2.1. Machinery-mounted multi-spectral imaging sensor 
and mobile research platform 

The neural-network data-mapping model was created 
to estimate maize leaf SPAD readings based on the grey 
levels of captured maize leaf images using a machinery- 
mounted MSI sensor. This MSI sensor was developed 
based on a multi-spectral charge-coupled device (CCD) 
camera capable of capturing images separately in 
multiple channels, and was mounted on a mobile liquid 
nitrogen sprayer. 

The characteristics of maize leaf reflectance were 
investigated over a wide spectrum (400-915 nm). A 
handheld spectro-radiometer (FieldSpec Hand held, 
ASD, Boulder, CO, USA) was used to measure the leaf 
reflectance from maize crops of nitrogen sufficient, 
nitrogen deficient, and average stress. As illustrated in 
Fig. 7, the leaf reflectance of nitrogen-deficient crops is 
higher than that of nitrogen sufficient or average 
stressed crops over the entire spectrum. However, the 
leaf reflectance differences between nitrogen sufficient or 
average stressed crops are not as consistent as compar¬ 
ing to that of nitrogen-deficient crop. From Fig. 7, one 
may also find that the leaf reflectance has no noticeable 
difference between nitrogen sufficient and average 
nitrogen-stressed crops in the low band of the spectrum 
(<500nm). Within the spectrum between 525 and 
725 nm, the leaf reflectance of maize crops with sufficient 
nitrogen shows a lower value than those with only 
average nitrogen stress. Such reflectance differences 
changed as the spectrum goes above 740 nm. The 
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observed spectrum indicates that the effective spectrum 
band detecting nitrogen stress levels is between 550 and 
700 nm in terms of leaf reflectance because the colour of 
nitrogen-stressed maize plant leaf is light green and the 
colour of nitrogen-sufficient leaf is dark green. The 
reflectance spectrum in green and red bands showed a 
noticeable difference with nitrogen stress. From the 
observed spectrum, it is seen that the reflectance of soil 
background is within the variation range of the leaf 
reflectance with different nitrogen stress levels in the 
most sensitive band (the green band) of the spectrum. 
Furthermore, the reflectance difference between the 
maize leaf and the soil background is easily observable 
in the high band of the spectrum (the near-infrared 
(NIR) band). 

To sense maize canopy reflectance in different bands, 
a Duncan MS2100 multi-spectral CCD camera (Duncan 
Tech, Auburn, CA, USA) was used to build the MSI 
sensor. This Duncan camera consists of three CCD 
channels of green (G, central band 550 nm), red (R, 
central band 660 nm) and (NIR, central band 800 nm) 
with a 25 mm focal length and a 14-6° field of view. Each 
channel can capture a separate image with a pixel 
resolution of 656 by 494. The principle of the tri-band 
CCD camera in capturing images using a single prism 
assembly is illustrated in Fig. 2. In this particular design, 
broadband light gathered by the lens enters the prism 
and is redirected by two long pass filters to three CCD 
sensors to be recorded in three bands of G, R, and NIR. 


In all three channels, the light enters and exits 
perpendicular to the prism faces, preventing refraction 
and enabling dichroic coatings to transmit at peak 
efficiency. A digital frame grabber (IMAQ PCI-1424, 
National Instrument, Austin, TX, USA) was used to 
record multi-spectral images captured using this camera 
at a maximum image acquisition rate of 30 images/s. 
The main function of the developed neural-network 
data-mapping model presented in this paper is to 
estimate SPAD value of maize leaf based on measured 
multi-spectral reflectance of the crop canopy for the 
MSI sensor. 

To support the baseline data collection and the 
developed neural-network model validation, a mobile 
research platform was constructed based on a modified 
Patriot XL sprayer (Tyler Industries, Inc., Benson, MN, 
USA). This sprayer platform consists of a 23 m spraying 
boom with 25 liquid fertiliser application nozzles (nozzle 
spacing of 0-76 m). Other than installing the MSI sensor, 
along with a personal computer (PC) used for data 
processing, the modification of the sprayer included the 
increase of undercarriage clearance to T80m to improve 
its travelability in the field during the growing season. 
After the modification (as illustrated in Fig. 3 ), the 
developed research platform could travel in the maize 
field during the entire growing season. The MSI sensor, 
installed in the front of the platform about 4-30 m above 
the ground, could capture crop canopy images covering 
2-70 m by 2-00 m (four rows of maize) in the field at a 
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Fig. 2. Principle and configuration of a three-channel multi-spectral charge-coupled device (CCD) camera in separating the entering 
lights; RS232, computer interface; NTSC/PAL, National Television System Committee/phase alternation line 



Fig. 3. System illustration of a sensor-based variable-rate nitrogen side-dressing applicator research platform with a machinery- 

mounted imaging maize nitrogen stress sensor; EPS, global positioning system 


maximum acquisition rate of 30 images/s. With the full- 
function ‘on-line’ image process tool developed (Noh 
et al ., 2005), this research platform could support real¬ 
time image data analysis to extract the nitrogen stress 
based on a ‘bird’s eye view’ canopy image captured in all 
three channels of R, G and NIR in every 4 s. This real¬ 
time image process rate can support the research 
platform to perform real-time sensor-based variable 
rate nitrogen application at a maximum speed of 0-5 m/ 
s. The neural-network-based data-mapping model is 
part of the efforts on increasing the image process rate, 
and therefore increase the operating speed of the 
research platform. 

2.2. Field experimental design 

A test plot was prepared to provide baseline data for 
sensor development and the training data set for the 


neural-network-based model, as well as a separate plot 
of maize with sufficient difference on crop nitrogen 
stress to support model validation tests. This test field is 
a 75-2 m long and 48-8 m wide flat agricultural land 
located at the Agricultural Engineering Research Farm 
of the University of Illinois at Urbana-Champaign, 
USA. The maize variety used in this study was 33P27 
and was, planted in late May. A total 64 rows of maize, 
with 0-76 m row spacing, were planted. Necessary weeds 
and insect controls were conducted as needed to 
maintain the test field reasonably free of weeds and 
insect-damaged plants. 

To obtain sufficient variations in nitrogen stress level 
on the crop, eight application rates of nitrogen treat¬ 
ment were applied to the crop as side-dressing at leaf 
stage V6 (vegetative growth stage of maize and 6 is the 
number of leaves, the crop heights between 0-15 and 
0-25 m) in the test field. The treatment application rates 
were defined as follows: rate 1 of 0 kg/ha; rate 2 of 
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34 kg/ha; rate 3 of 67 kg/ha; rate 4 of 101 kg/ha; rate 5 of 
135 kg/ha; rate 6 of 168 kg/ha; rate 7 of 202 kg/ha; and 
rate 8 of 235 kg/ha. Four replicates of each treatment were 
designed for a total of 32 test plots with each plot sized 
18-8 m by 6-lm (eight rows). A completely randomised 
block design was used to assign the specific level of 
nitrogen treatment to each test plot, as shown in Fig. 4. 

In collecting a training data set for the development of 
the neural-network model, both multi-spectral images 
and SPAD meter readings of maize leaves were collected 
from each of the test plots. The field data collection 
started at the leaf stage V6 and ended at growth stages 
R4 (dough stage). All the captured images were 
calibrated using a real-time background separation 
and dynamic image calibration algorithm (Noh et al ., 
2005) and then represented as the reflectance value of 
maize canopy in R, G and NIR bands. Each reflectance 
value was coupled with the average SPAD value (based 
on eight readings) measured from the maize crops on 
which the multi-spectral images were taken as one 
training data set. Equation (1) shows an example set of 
the training data D Ti collected from the field test. 

D T ,i = { 0-1082 0-0545 0-4189 41-4} (1) 

The first three numbers are the maize canopy 
reflectance detected by G, R and NIR channels of the 
multi-spectral camera and the fourth number is the 
corresponding average SPAD reading measured from 
the crops in the sensed area the same day the multi- 
spectral images were collected. These data sets were used 
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Fig. 4. Experimental design of nitrogen application in the test 
field for model development and field validation tests (the first 
number in block represents the repetition of a nitrogen treatment 
level and the second number represents the level of nitrogen 

treatment) 


as the training sets for the proposed neural-network 
model development. 

2.3. Neural-network data-mapping model development 

Neural networks are known as useful tools for pattern 
recognition, identification, and classification. A neural- 
network model can determine the input-output relation¬ 
ship for a complicated system based on the strength of 
their interconnections presented in a set of sample data 
(Howard & Mark, 2000). Such a model can provide data 
approximation and signal-filtering functions beyond 
optimal linear techniques (Clifford & Lau, 1992). 
Therefore, neural-network models provide more robust 
results for complicated system analysis than conven¬ 
tional mathematical models. 

In this research, a BP neural-network model was 
created and trained using the reflectance of maize 
canopy detected at R, G and NIR bands as the inputs 
and the measured corresponding SPAD reading as the 
output. The topological structure of this BP neural- 
network model consisted of three input neurons in the 
input layer and one output neuron in the output layer to 
match the 3-1 input-output pattern of the training data 
set. One hidden layer with six neurons was one optimal 
topology for the neural-network model determined by a 
trial-and-error method. The evaluation criterion for 
determining the optimal topology was the best correla¬ 
tion value of the training set. 

The neural-network model was trained in an iterative 
training process using the obtained training set as 
illustrated in Eqn (1). The input variables are read in a 
BP model with each neuron thresholding the summation 
of its input variables based on their corresponding 
weighting values. The threshed summation is then 
presented as the best estimation of the output value. 
To avoid possible bias, the order of input-output data 
pair in a training data set was randomised before the 
training process. During the training process, the BP 
training algorithm compares the estimated output value 
with the target value (namely the measured value), then 
tunes weighting values connecting all the neurons to 
minimize the difference between the estimated and the 
target values until the error is smaller than a predefined 
level or the number of the iteration reached a preset 
maximum number. The range of a neural-network 
model in estimating the output value is greatly 
dependent on the completeness of the training data set 
covering the possible cases of the system being modelled. 
After completing the training process, all weighting 
indices describing the interconnection strengths between 
neighbouring neurons are fixed, and the neural-network 
model will then be capable of mapping input variables 
to an estimated output promptly and accurately. 
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The neural-network model developed in this research 
applied a sigmoid transfer function to compute for the 
strength of interconnection between each pair of 
neurons. The input variables in this model were 
normalised based on their possible ranges to avoid data 
saturation using the following equation: 

_ X Xynin 

Xnorm — W) 

Xmax X m in 

where x, x min , x max and x norm are the real-valued input 
variable, the minimum and maximum possible values 
of the input variable, and its normalised value, 
respectively. 

The output from this neural-network model is an 
indexed value that corresponds to the input variable. To 
get the real-valued output, the indexed output value 
needs to be denormalised according to the following 
equation: 

y ynorm (k max ymin) "F ymin (3) 

where y, y min , JW and y norm are the real-valued output 
variable, the minimum and maximum possible values of 
the real-valued output, and the indexed output value 
from the neural-network model, respectively. 


3. Results and discussion 

In this research, 192 training data sets were obtained 
during six-field data collection tests conducted biweekly 
between V6 and R4 stages of maize growth. A pre¬ 
determined threshold value for the output error 
(accumulated error in real-valued maize SPAD estima¬ 
tor) was set as 11 and the preset maximum iteration 
number was set as 20 000. When the model consists of 
one hidden layer of three neurons, the learning cycle was 
terminated at 20 000 iterations with an output error of 
11-6605, above the pre-determined threshold value. By 
trying different numbers of hidden layers and different 
numbers of neurons in each hidden layer, it was found 
that optimal results were obtained when the neural- 
network model had one hidden layer of six neurons. The 
learning cycle was terminated at 30 825 iterations with 
an output error of 11. Table 1 lists the obtained 
weighting indices for each neuron. 

Before the model can be confidently applied to 
estimate the SPAD values to determine maize nitrogen 
stress levels, it is necessary to validate the model by 
checking the degree of the model estimated SPAD 
values matching with the measured values obtained 
from field tests. To perform the validation study 
faithfully, the validation set of the input-output pairs 
was collected from separate field data collection tests on 
the same field, but different locations in each testing 


Table 1 

Weighting indices between each neuron in the optimal neural 

network model 


Link between 

neurons 

Weighting 

index 

Link between 

neurons 

Weighting 

index 

Il-Hl 

18-4296 

Hl-Ol 

-10-9303 

I1-H2 

-63-5298 

H2-01 

6-0884 

I1-H3 

10-7655 

H3-01 

4-6231 

I1-H4 

45-0456 

H4-01 

-5-8142 

I1-H5 

-40-8842 

H5-01 

-10-1149 

I1-H6 

-15-5561 

H6-01 

-7-5266 

I2-H1 

0-3101 



I2-H2 

14-4936 



I2-H3 

-1-5412 



I2-H4 

0-6924 



I2-H5 

-4-7591 



I2-H6 

-21-4303 



I3-H1 

-37-6036 



I3-H2 

-31-1832 



I3-H3 

-52-5858 



I3-H4 

-9-2959 



I3-H5 

16-2708 



I3-H6 

-25-2170 




Note : I, input layer; H, hidden layer; O, output layer; 1, 2,..., number 
of the neuron. 


plot. The location of validation samples being collected 
was controlled using a GPS. Fifty sets of test, covering 
the SPAD values from 26-35 to 55-2, were collected to 
support the validation study. The results presented in 
Fig. 5 show the estimated SPAD data matching the 
actually measured maize SPAD readings well. Each 
measured SPAD value was an average of eight readings 
taken in the same as the multi-spectral images were 
captured. The maximum offset between the estimated 
value and the measured value among these 50 sets data 
was 7-3, with a root mean square (RMS) error of 2-52. 
Regression analysis of the neural-network model esti¬ 
mated values resulted in the following regression 

• • o 

equation (value for the coefficient of determination r 
of 0-89): 

SpAD,est = 0-93 SpAD,meas + T64 (4) 

where, S PADest is the estimated value and S PADmeas is 
the measured value by the SPAD meter. 

To assess the performance of the neural-network 
model more thoroughly, a comparison study between 
the neural-network model and a baseline regression 
model was made. The baseline model was a best-fit 
regression model obtained from canopy reflectance 
analysis of maize crops {Fig. 6). A separate study 
(Noh et al ., 2005) revealed that maize leaf reflectance in 
the G channel of the multi-spectral image has a strong 
correlation with measured SPAD value in a negative 
exponential form. Applying this method to this research 
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Fig. 5. Correlation of soil plant analysis development (SPAD) values estimated using the neural-network model to the actually 

measured maize leaf value; the measured SPAD values are the average eight field readings 



Green reflectance 

Fig. 6. Regression model of measured maize SPAD values and measured canopy reflectance in the green channel of the multi-spectral 
camera: —linear regression; power regression; SPAD, soil plant analysis development; r 2 , coefficient of determination 


the result was (r = 0-69) as follows: 

SpAD.es, = 9-37 Rp 6X (5) 

where R G is the green reflectance from the MSI sensor. 

Comparing the r values from estimated SPAD values 
using both the neural-network model and the best-fit 


regression model including the exponential model, the 
neural network model shows more strong correlation 
than the other prediction models (Fig. 7). The maximum 
offset of the 50 estimations obtained from the ‘best-fit’ 
model was 8-8, compared to 7-3 from the neural- 
network model. Similarly, the RMS error was 343 from 
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Fig. 7. Comparison of estimated SPAD values using an artificial neural-network model (—, ANN) and a ‘best-fit’ regression model 
using the normalised difference vegetation index(NDVI): ♦ ,ANN estimated data; ■ , ND VI estimated data; SPAD, soil plant 

analysis development; r 2 , coefficient of determination 


the ‘best-fit’ model in comparison with 2-52 from the 
neural-network model. Regression analysis of the best- 
fit model estimated values resulted in the following 
regress equation (r of 0-75): 

S>PAD,est ~ 0-79 SpADjneas T 8-12 (6) 

Comparing results (the r value, maximum offset, and 
RMS error) from Eqn (6) with Eqn (4), it is verified that 
the neural-network model can provide more accurate 
estimations on maize canopy SPAD values than a ‘best- 
fit’ regression model could. More importantly, a well- 
trained neural-network model can be implemented in 
real-time to estimate the required SPAD values in terms 
captured maize canopy reflectance in all three channels 
of the multi-spectral camera with a minimal computa¬ 
tional load. 


4. Conclusions 

A machinery-mounted multi-spectral imaging (MSI) 
sensor can provide an effective means to detect maize 
nitrogen stress levels in real-time during side-dressing 
operation. Such information is essential in performing 
efficient variable rate nitrogen application in terms of 
actual need. As an MSI sensor cannot directly measure 
maize nitrogen stress, it instead captures crop canopy 
reflectance in three different channels; the key to making 
such an MSI sensor workable in real time is its 


capability in assessing maize nitrogen stress in terms of 
captured canopy reflectance. This research developed a 
real-time implementable neural-network model to fur¬ 
nish such a capability to the MSI sensor. In this neural- 
network model, the input data are the normalised maize 
canopy reflectance in red (R), green (G) and near- 
infrared (NIR) channels of the MSI sensor, and the 
output from this model is the best estimation of soil 
plant analysis development (SPAD) reading, a com¬ 
monly used means to assess maize nitrogen stress levels. 
After being tuned using a training set, consisting of both 
the crop canopy reflectance in three channels of the MSI 
camera and a measured SPAD value from the same 
crops from which the image is taken, collected from the 
test field under various operation conditions, the 
developed neural-network model can accurately esti¬ 
mate SPAD values of maize canopy in real-time. The 
accuracy of the SPAD values estimated using the neural- 
network model is higher than that estimated using a 
‘best-fit’ model. 

This research verified that the neural-network model 
could provide effective and faithful estimation on maize 
nitrogen deficiency based on the sensed crop canopy 
reflectance. The value for the coefficient of determina¬ 
tion was 0-89 and the root mean square (RMS) error 
was 2-52 SPAD value. Based on the results obtained 
from this study, it can be concluded that using a neural- 
network model, the multi-spectral charge coupled device 
(CDD) camera can provide sufficient information to 
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perform reasonable SPAD values estimation on-the-go 
during field operations. 
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